International 

open 3 access Journal 

Of Modern Engineering Research (IJMER) 



An Automated Method for Segmentation of the Hand In 

Sign Language 

B. Luna-Benoso 1 , R. Flores-Carapia 2 , O. Camacho-Nieto 3 , A. L. Barrales- 

Lopez 4 , H. Flores-Gutierrez 5 

^Escuela Superior de Computo, Instituto Politecnico National, Mexico) 
2, 3, 4, 5 (Q entro d e Innovation y DesarrolloTecnologico en Computo, Instituto Politecnico National, Mexico) 

t > 

Abstract: This paper presents an automated method for hand segmentation in images that make use of 
signs language. For this, used an images bank that was captured by a webcam to which were applied 
spatial domain methods for hand segmentation. 
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I. Introduccion 

Around of 70 million deaf people in the world use the signs language as their maternal language or 
main language [1]. The difficulties faced the people deaf-mute in the daily life are quite due to the difficult 
understanding or total ignorance of signs language meaning that use. The signs language is a communication 
mean for the people with deficiency hearing, where the words and sentences are represented for hand gestures, 
and have grammatical structures perfectly defined. Due to the difficult communication that be between a deaf 
people that use the signs language for take charge of the translation process with the finality of study to deeply 
the deaf culture with psychotherapeutic purpose[2]. A system capable of carry out the automatic recognition of 
sign language without the need of an individual translator can eventually provide an excellent tool for deaf 
people to communicate with people that disown the language, and this way we can achieve a better way to live 
[3]. This paper proposes a methodology for carry out the automatic segmentation of hand in images that show 
the Mexican sign language (figure 1). For this, images were captured by a people webcam doing some Mexican 
sign language, later with digital treatment techniques of images basing in the spatial domain was obtained the 
sign segmentation doing by the individual. 
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Figure 1 : Mexican sign language 



II. Basic concepts 

In the section three will be shown the proposed method, however for that, make use of the 
mathematical morphology, and for that reason, in the following lines we show the concerning concepts for the 
mathematical morphology. 

The mathematical morphology is a framework based exclusively in the set theory. The original theory 
developed by Georges Matheron and Jean Serra, has been used with huge success in the digital processing of 
binary images. There are two fundamental operations in the mathematical morphology: dilatation and the 
erosion. The dilatation is a term referred to increase, expand, rise, among other actions, of any object. On the 
other hand, the erosion is referred to the contraction, reduction, decrease, among other actions, of any object. In 
the following lines are the accuracy definitions of the fundamental operations of the mathematical morphology. 
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2.1 Dilation 

Started the short dilation operation study. For this, consider in all that follow, discrete sets 2 -dimensional, that 
is, subsets of 1? . 

Definition 2.7.7:BeA <= 1? . The set A is denoted byA ~, is defined by: 

A" = {-x|x G A}(1) 

Definition 2.7.2:BeA <= Z 2 andx G 7L 2 . The translation of A by x denoted by (A) x is defined as: 

(A) x = {a + x|a £A}(2) 

The following definition shows the formal concept of what is dilation operation. 

Definition 2.1.3: Be A, B c^ 2 , the dilation of A by B, denoted byA 0 B, is the sum of Minkowskiof A and B; 
this is: 

A © B = {a + b|a G A and b e B} (3) 
The set B of the previous definition will be called structuring element. 



Figure 2: Representing the set A, the structuring element B = {(0,0), (1,0), (2,0)} and the dilationA 0 B 

Theorem 2. 1. 1 :Be A, B c 1} . It holds that: 

A 0B = {x|(B-) x HA gfc 0}(4) 

Demonstration'. 

x G A 0 BIfx= a + b for somea G A and b G B if x — b = a for some a G A and b G B if x — b = a for some 
a G A and -b G B" if a - x = -b for some a G A and -b G B~ if a G (B~) x and a G A if a G (B") x n A for 
some a if (B~ n A) 0. ■ 

The previous theorem allows us to define an alternative form, which is the dilation of a set A by the structuring 
element B. 

2.2 Erosion 

Then be show the formal concept of what is erosion. 

Definition 2.2.1: Be A, B <= 1? . The erosion of A by B, denoted by A 0 B, the subtraction of Minkowski of Aby 
B; this is: 

A 0 B = {x G 1? |x + b G A for each b G B} (5) 



Figure 3: Representacion the set A, the structuring element B = {(—1, 0), (0,0), (1,0)} and the erosion A 0 B 
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Theorem 2.2.1: be A, B it holds that: 

A0B = {x|(B) x CA) (6) 

Demonstration: 

x G A 0 BIfx + b G A for each b G B by the definition 2.2.1 if (B) x c A by the definition 2.1.2 ■ 

The previous theorem allows us to define an alternative form, which is the erosion of a setA by the structuring 
element B. 

III. Proposed method 

Before to arrive on detail with proposed method, it's necessary give the definition about a digital 
image. A digital image is a Two-dimensional function f (x,y), of the light intensity (Sheen/brightness) on a 
space point, so (x,y), the coordinates for that point [9]. Inasmuch as a digital image is a function f(x,y) 
discretised on the space coordinates so in the sheen, sometimes could be representative like a two-dimensional 
matrix = (fij) mxn , where m and n are the size of the image and f^ = f (x i; x^). 

The proposed method is dived in two parts: 1) image acquisition and 2) signal segmentation of the individual 
done. 

1) Image acquisition: With webcam help, to get images of persons doing a signal of LSM set. Like in 
figure 4. 




Figure 4: Imageacquisition. 

2) Signal segmentation: For this part it could be considerate the next stages: 

Step 1 . The image need to be separate in three components red, green and blue (RGB) and it was considerate the 
red component because of the human skin is more sharp for this component (figure 5). 

Step 2. It was considerate to grayscale from red component, this is, the value of the red component is copied to 
the green and blue component, thereby obtaining the image in grayscale. 



Figure 5: Decomposing an image into its three RGB components, and grayscale. 
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Step 3. The histogram was obtained of the image with gray levels in the range [0, 255], where the histogram is a 
discrete function H[k] represents the number of colors of each gray level (k = 0, . . ., 255) [9]. 

Step 4. Given an image f (x, y)and two variables u and v, the binarization by thresholding is used defined as 
follows: 



h =[ 0 ifU " fij " V 

1255 iff, <uorL >v 



Shown in Figure 6, that the histogram shows two maximum peaks at 0 and 255, to eliminate these peaks, were 
considered as thresholds u = 20 and v = 185. 




Figure 6: Show the first 4 steps applied to a color image. 

Once obtained, the binarized image, we proceeded to locate the corresponding part of the hand, for it is 
considered that: 

Step 5. Consider a mask size x within a mask size y as shown in Figure 7. Variables u and v be two to locate the 
area corresponding to the hand image, the following function is implemented for each point (i, j) on the image, it 
is My mask size and centered at (i, j), the function Tyis defined at each point (i, j)as: 



T ■ M J 



[0,255] 



Where 



r f if A Y >u and A v — A Y < v 

T-(r s) = \ Trs y 
hjV,*J \ 2SS if A x < u or A y — A x > v 



Withi4 x and A y the areas enclosed by the masks of size x and y respectively. 
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Figure 7: Masks of size x and y. 

Step 6. Once located the section of image binary corresponding of the hand, morphological erosion operator was 
applied. 
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Step 7. Morphological dilation operator was applied. 

The figure 8 shows the process of applying erosion to the image hand segmented with a Moore neighborhood, 
and subsequently applying dilation 6 times with the same vicinity. Finally, shows the image of the hand 
segmented to color. 
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Figure 8: Process segmentation of the hand to locate the sign on. 
IV. Conclusion 

This paper is presented an automated method for segmentation of abnormalities in digital 
mammography images. The method was applied an images bank that was captured by a webcam The proposed 
segmentation method can be a useful to the development of computational systems that address the problem of 
patterns classification focused on the problem of sign language. 
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